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ABSTRACT 

Often  a  link-state  routing  takes  a  form  of  the  cost  based  scheme 
which  admits  an  arriving  request  on  the  minimum  cost  route  if 
this  cost  does  not  exceed  the  cost  of  the  request,  and  rejects  the 
request  otherwise.  Cost  based  strategies  naturally  arise  as  a 
result  of  optimization  of  the  network  performance  or 
incorporating  Quality  of  Service  (  QoS  )  requirements  into  the 
admission  and  routing  processes.  In  the  former  case  the 
implied  cost  of  the  resources  represents  expected  future 
revenue  losses  due  to  insufficient  resources  for  servicing  future 
requests.  In  the  latter  case  the  cost  of  a  route  represents  the 
expected  level  of  QoS  ,  e.g.,  bandwidth,  delay,  packet  loss, 
etc.,  provided  to  the  request  carried  on  this  route.  In  both  cases 
due  to  the  aggregation,  statistical  nature  of  the  resource  costs, 
delays  in  disseminating  signaling  information,  non-steady  or 
adversarial  operational  environment  the  cost  of  the  resources 
may  not  be  known  exactly.  Usually  this  uncertainty  is  modeled 
by  assuming  that  resource  costs  are  random  variables  with 
fixed  probability  distributions.  We  propose  to  explicitly 
recognize  that  the  minimum  cost  route  selection  as  an  ill-posed 
problem  and  to  view  randomized  routing  as  a  regularized 
solution  to  this  problem.  We  consider  a  specific  case  of 
regularization  intended  to  guard  against  adversarial  uncertainty, 
i.e.,  worst  case  scenario,  with  respect  to  the  resource  costs  lying 
within  known  "confidence"  intervals.  Assuming  that  the 
network  minimizes  and  the  adversarial  environment  maximizes 
the  losses  resulted  from  non-optimal  admission  and  routing 
decisions  due  to  the  uncertainty,  we  identify  the  optimal 
admission  and  routing  decisions  with  the  Nash  equilibrium 
strategy  in  the  corresponding  game.  We  explicitly  identify  this 
strategy  in  a  case  of  parallel,  homogeneous  structure. 

Keywords:  randomized  routing,  minimum  cost  routing, 
uncertainty,  regularization,  games,  Nash  equilibrium. 

1.  INTRODUCTION 

Often  a  link-state  routing  takes  a  form  of  the  cost  based  scheme 
which  admits  an  arriving  request  on  the  minimum  cost  route  if 
this  cost  does  not  exceed  the  cost  of  the  request,  and  rejects  the 
request  otherwise.  Cost  based  strategies  naturally  arise  as  a 
result  of  optimization  of  the  network  performance  [1]  or 
incorporating  Quality  of  Service  (  QoS  )  requirements  into  the 
admission  and  routing  processes  [2].  In  the  former  case  the 
implied  cost  of  the  resources  represents  expected  future 
revenue  losses  due  to  insufficient  resources  for  servicing  future 
requests.  In  the  latter  case  the  cost  of  a  route  represents  the 
expected  level  of  QoS  ,  e.g.,  bandwidth,  delay,  packet  loss, 
etc.,  provided  to  the  request  carried  on  this  route.  In  both  cases 
due  to  the  aggregation,  statistical  nature  of  the  resource  costs, 


delays  in  disseminating  signaling  information,  non-steady  or 
adversarial  operational  environment  the  cost  of  the  resources 
may  not  be  known  exactly. 

This  uncertainty  does  not  affect  the  routing  decisions  if  the 
minimum  cost  route  can  be  identified  with  required  degree  of 
confidence.  The  problem,  however,  is  that  due  to  the  very 
nature  of  the  minimum  cost  routing,  the  minimum  cost  route 
typically  cannot  be  identified  with  a  reasonable  degree  of 
confidence.  Indeed,  except  for  some  anomalies,  the  cost  of  a 
link  is  an  increasing  function  of  the  link  load.  Minimum  cost 
routing  increases  the  load  carried  on  a  minimum  cost  route 
until  admission  control  takes  over,  or  at  least  two  routes  have 
the  same  cost.  This  positive  feedback  attempts  to  equalize  the 
costs  of  several  routes  with  each  other  and  with  the  cost  of  a 
request,  and  may  cause  oscillations  in  the  optimal  route 
selection,  which  are  perceived  as  route  flapping  phenomenon 
when  the  frequency  of  optimal  route  updates  significantly 
increases. 

Usually,  uncertainty  in  the  resource  costs  is  modeled  by 
assuming  that  the  resource  costs  are  random  variables  with 
fixed  probability  distributions,  which  may  or  may  not  be 
known  to  the  network  [2].  From  decision  theoretic  perspective 
this  approach  lies  within  Bayesian  framework  [3J.  However, 
even  when  the  forms  of  the  probability  distributions  can  be 
reliably  identified,  e.g.,  exponential  distributions  for  the  delays, 
the  parameters  of  these  distributions,  e.g.,  average  delays, 
remain  to  be  subject  to  uncertainty  within  the  corresponding 
confidence  regions,  leaving  the  problems  of  sensitivity  and 
instability  unresolved.  Empirical  results  suggest  that 
performance/robustness  curve  of  the  routing  algorithm  can  be 
often  improved  by  allowing  randomization  of  the  routing 
decisions  [4],  However,  Bayesian  framework  resulted  in 
deterministic  optimal  strategies  does  not  allow  one  to  support 
and  quantify  this  claim. 

This  paper  proposes  to  tackle  the  problem  of  uncertainty  in 
the  resource  costs  by  viewing  route  cost  minimization  as  an  ill- 
posed  problem  [5].  The  standard  technique  for  solving  ill- 
posed  problem  is  regularization,  i.e.,  penalizing  solution  for 
sensitivity  to  the  variable  contaminated  by  noise.  We  propose 
to  view  randomized  routing  as  a  regularized  solution  to  the 
route  cost  minimizatio  problem,  where  regularization  is  based 
on  the  "confidence  region"  C  £  C  rather  than  point  estimates 

C  ~  C  for  the  vector  C  =  (Cj )  of  the  link  costs  Cj .  In  a 

situation  when  link  costs  lie  within  certain  confidence  region, 
the  set  of  "acceptable"  routes  includes  all  feasible  routes,  which 
may  be  optimal,  given  the  constraints  imposed  by  the 
confidence  interval.  We  propose  to  regularize  solution  to  the 
routing  optimization  problem  by  randomizing  routing  selection 
within  the  optimal  set  of  routes.  Different  regularization 
techniques  lead  to  different  randomization  among  acceptable 
routes.  This  framework  can  be  extended  to  a  situation  of 
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random  link  costs  with  probability  distributions  containing 
uncertain  parameters. 

We  consider  a  specific  case  of  regularization  intended  to 
guard  against  adversarial  uncertainty,  i.e.,  the  worst  case 
scenario,  with  respect  to  the  resource  costs  lying  within  known 
confidence  regions.  Assuming  that  the  network  minimizes  and 
the  adversarial  environment  maximizes  the  losses  resulted  from 
non-optimal  admission  and  routing  decisions  due  to  the 
uncertainty,  we  identify  the  optimal  routing  with  Nash 
equilibrium  strategy  in  the  corresponding  game.  We  explicitly 
identify  the  corresponding  Nash  equilibrium  routing  strategy  in 
a  case  of  parallel,  homogeneous  structure  under  various 
scenarios  for  the  adversarial  environment.  The  game  theoretic 
framework  approach  to  network  management  under  uncertainty 
has  been  proposed  in  [6]  and  then  applied  to  cost  based 
admission  control  for  a  case  of  a  single  feasible  route  in  [7], 
Various  assumptions  on  the  capabilities  of  the  adversarial 
environment  to  manipulate  the  link  costs  produce  different 
game  models.  For  example,  in  a  case  of  extremely  omnipotent 
environment,  capable  of  synchronized  selection  of  the  link  cost 
for  all  links,  the  adequate  game  model  includes  two  players:  the 
network  and  the  environment.  In  a  case  when  link  costs  are 
selected  independently  for  different  links,  the  adequate  game 
model  is  a  non-cooperative  game  of  1  +  L  players  where  the 
number  of  links  in  the  network  is  L  .  In  this  game  model  one 
player  representing  the  network  is  trying  to  minimize  losses 
and  other  L  players  representing  network  links  are  trying  to 
maximize  losses.  Various  intermediate  scenarios  with  respect 
to  synchronization  of  link  costs  are  possible. 

Optimization  algorithms,  assuming  exact  knowledge  of  the 
link  states,  solve  the  problem  of  routing  instability  by  splitting 
traffic  with  the  same  origin-destination  among  routes  of  the 
same  cost.  These  algorithms  are  based  on  rerouting  of  the 
infinitesimal  portions  of  the  load,  and  take  form  of  iterative 
process  [8]  or  discontinuous  differential  equations  describing 
sliding  modes  [9],  The  obvious  difficulty  of  applying  these 
algorithms  is  that  their  stability  is  guaranteed  only 
asymptotically  as  load  granularity  decreases.  Even  more 
important  is  that  the  optimal  traffic  split  seems  to  be  very 
sensitive  to  the  unavoidable  uncertainties  in  the  fluctuations  in 
the  rates  of  incoming  traffic.  Randomization  of  the  routing 
decisions  can  be  viewed  as  an  attempt  to  obtain  stable  traffic 
split. 

The  paper  is  organized  as  follows.  Section  2  describes  a 
minimum  cost  routing  and  its  randomized  version.  Section  3 
characterizes  losses  and  risks  associated  with  the  admission  and 
routing  decisions  under  uncertainty.  Section  4  describes  game 
theoretic  framework  for  risk  management.  Section  5  explicitly 
identifies  the  optimal  admission  strategy  by  solving  the 
corresponding  game  in  a  case  of  parallel  homogeneous 
structure.  Finally,  conclusion  briefly  summarizes  results. 

2.  ROUTING 


the  utility  function  can  be  extended  as  follows:  U0  =  0  .  where 

r  =  0  means  that  the  request  is  rejected.  Given  the  network 
state  X ,  the  optimal  routing  strategy  chooses  control  action  that 
yields  the  maximum  utility: 


rop,=w g  “A  (!) 

‘  re{0,F) 

Often  link  state  routing  takes  form  of  the  cost  based  scheme  with  utility 
function 


It,  =  ■ 


(2) 


w-cr  if  r  t*  0 

^  0  if  r  =  0 

where  the  cost  of  an  arriving  request  is  W ,  and  the  cost  of  a 


route  is  Cr  .  Usually  the  route  cost  is  assumed  to  be  additive: 


c  =L 


ler'-l 


(3) 


where  the  cost  of  a  link  I  is  C(.  For  example,  network 

performance  oriented  minimum  cost  schemes  weight  the  revenue 
brought  by  the  arriving  request  W  against  the  expected  future  revenue 

losses  c r  due  to  insufficient  resources  for  servicing  future 

requests  resulted  from  tying  up  certain  bandwidth  on  links  /  G  r  [1]. 

In  this  case  Cj  is  the  implied  cost  of  a  link  I .  The  utility  (2)  is 

the  surplus  value  i.e.,  the  difference  between  the  revenue  brought 
by  the  admitted  request  W  and  the  implied  costs  of  the 

occupied  resources  Cr  .  Maximization  (1)  of  the  utility  function  (2) 
results  in  the  following  admission  and  routing  strategy 
[  r*  if  c*  <  w 

|0  if  c*  >  w 


r  =  ■ 

opt 


(4) 


where  the  route  r*  of  minimum  cost  C*  is  determined  by 

c*  =  cr  =  min  cr  (5) 

*  reF 

The  joint  problem  of  rate  control  and  routing  based  on 
resource  pricing  [10]  can  be  also  presented  in  form  (l)-(2). 
Assuming  that  the  user  S  utility  of  transmission  at  rate  y  is 

U  ( y )  ,  and  the  incremental  price  of  occupying  resources  on 

route  r  is  c  ,  a  reasonable  user  S  is  expected  to  choose  his 
transmission  rate  y  and  route  r  e  F  by  solving  the 
following  individual  optimization  problem  [10]: 

max  R()')-cr.y}  (7) 

reF,v>  0 

Optimization  problem  (7)  can  be  solved  as  a  two  step 
procedure  with  first,  finding  minimum  cost  route  (l)-(2),  and, 

then,  determining  the  optimal  transmission  rate  y  =  y°p'  by 
solving  equation  d  U  / dy  =  C*  . 


Minimum  Cost  Routing:  Deterministic  Link  Costs 

In  a  link-state  model  a  network  topology  database  keeps  state 
information  about  nodes  and  links  in  the  network 

X  =  (x;  )  G  X  where  X,  is  the  vector  characterizing  the  state  of  a 
link  /  and  adjacent  to  this  link  nodes.  Often  the  result  of  selecting 
route  r  from  the  set  of  feasible  routes  F  =  {r1,...,rK  }  can  be 
characterized  by  some  utility  function  U r  =  u(Xr  )  where  vector 
Xr  =  (x;  :le  r)  characterizes  the  state  of  links  /  e  r  . 
Assuming  that  rejection  of  a  request  has  utility  zero,  the  definition  of 


Minimum  Cost  Routing:  Random  Link  Costs 

Assuming  that  the  state  of  the  network  X  =  (Xj )  G  X  is  a 
random  variable  with  given  probability  distribution  P(x)  ,  the 
optimal  routing  decision  yields  the  maximum  average  utility  [2]: 

r  =  arg  max  E[ur]  (8) 

1  re{0,F} 

For  the  cost  based  scheme  (2),  the  average  utility  is 

j w-E[cr ]  if  r*0 

0  if  r  =  0 


(9) 


In  a  case  of  additive  cost  function  (5),  the  optimal  route  selection  (8) 
is  based  on  the  average  link  costs.  In  a  case  of  QoS  routing  [2] 
the  utility  function  is 


ftp  (w-cr)  if  r*0 
[  0  if  r  =  0 


(10) 


where  W  characterizes  the  minimum  level  of  the  QoS 


acceptable  for  the  arriving  request,  and  cr  represents  the  level 
of  QoS  ,  e.g.,  bandwidth,  delay,  packet  loss,  etc.,  provided  to 
the  request  carried  on  this  route.  Typically  nonlinear, 
increasing  and  concave  function  Cp(^)  represents  the  user 

utility  of  receiving  QoS  W  +  ^  ,  while  the  required  level  of 
QoS  is  W  [2].  Function  cp(^)  allows  one  to  describe  the 
user  "soft"  QoS  requirements.  A  particular  case  of  user 
"hard"  QoS  requirements  corresponds  to  the  following 
specific  selection  of  the  function  Cp  )  : 


(p(^  CO)  = 


(ID 


co  if^>  o 

-  oo  if  E,  <  0 

with  some  positive  constant  (0  >  0  .  Note  computational 
difficulties  associated  with  solving  optimization  problem  (8)  in 
a  case  of  non-linear  function  cp  (^  ) 

The  following  parameterized  family  of  functions  provides 
convenient  approximation  for  the  utility  function  cp  (E,  )  : 


cp(^  co,y)  =  co(l  —  ) 


(12) 


where  CO  >  0  and  y  >  0  are  some  parameters.  Function  (12) 
is  monotonously  increasing,  concave  in  ^  for  any 


(co,y)e  (O.oo)2 .  when  co  — > °° ,  y^O, 

toy  =  P  =  const ,  family  (12)  yields  a  linear  utility  function 

Cp(^|(0,y)  =  (3£,  .  When  CO  =  const  ,  y  — >  00  ,  family 
(12)  yields  utility  function  (11). 


applications  vector  C  is  contaminated  by  some  noise, 
optimization  problems  (8)  as  well  as  (15)  are  ill-posed. 

The  standard  technique  for  solving  an  ill-posed  problem  is 
regularization,  i.e.,  penalizing  solution  0C  for  sensitivity  to 
contaminated  variable  C  [5].  In  a  case  of  a  minimum  cost 
routing  (10)  it  is  natural  to  assume  that  the  vector  of  link  costs 
C  =  (Cj)  can  be  more  reliably  represented  by  the  "confidence 
region"  ce  C  than  the  point  estimate  c  ~  C  .  Define  the  set 
of  "acceptable"  routing  decisions  re  F.t  C.{0,F}  to  be  the 
set  of  all  feasible  routing  decisions  that  may  be  optimal,  given 
the  confidence  regions  for  the  link  costs.  Reasonable 
randomized  routing  strategies  assign  positive  probabilities  to  an 
acceptable  routing  decision,  and  zero  probability  to  an 
unacceptable  routing  decision: 

ar  >  0  if  re  Ft.  (16) 

0C(.  =0  if  r€  Ft  (17) 

This  regularization  framework  can  be  easily  extended  to  a 
case  of  random  link  costs  by  assuming  that  the  form  of  the 
distribution  for  the  vector  C  is  known,  but  the  parameters,  e.g., 
moments,  are  subject  to  uncertainty  within  known  "confidence 
regions".  In  the  rest  of  the  paper  we  consider  a  game  theoretic 
framework  which  leads  to  a  specific  selection  of  probabilities 

0C(.  satisfying  conditions  (16)-(17). 

3.  Losses  and  Risks 


Losses 

The  losses  resulted  from  non-optimal  network  admission  and 
routing  decisions  due  to  the  uncertain  link  costs  C  =  (<y  )  can 
be  quantified  by  the  following  loss  function  [6] -[7]: 

L(c,r)=  max  u  .(c)-u(c)  (18) 

r’e{0,F) 


Combining  (18)  with  (10)  we  obtain  the  following  expression 
for  the  loss  function: 


L(c,  r ) 


max{0,tp(w-  c«)}-  cp(w- 
max{0,cp(u>-  c* )} 


■cr)  if  r  A  0 
if  r  =  0 


(19) 


Randomized  Routing 

Consider  a  situation  when  route  re  {0,  F]  is  selected  with 
probability  0C(. ,  where  the  admission  probability  is 
0C  =  1  —  OC0 ,  and 

£ar  =  1,  ar  >  0,  Vr  g  {<Z>,F}  (13) 

The  expected  utility  of  this  randomized  routing  decision  is 

w(0C)  =  EreFa'£K]  (14) 

where  the  average  utility  of  selecting  route  re  F  is  E[llr  ]  . 
Maximization  of  the  expected  utility  (14)  with  respect  to  the 
distribution  OC  =  (0C  r  ) 

maxt7(a,c)  (15) 

a 

subject  to  constraints  (13)  yields  degenerative  solution 
0Cr  e  {0,1}  which  describes  the  optimal  deterministic  routing 
decision  based  on  maximization  of  the  average  utility  (8).  In  a 
case  of  deterministic  route  costs  C  =  (c  )  ,  this  procedure 
results  in  routing  (1).  Optimal  solution  to  (15)  is  a 
discontinuous  function  of  vector  C  on  the  hyper  planes  where 
two  or  more  routing  decisions  are  optimal.  Since  in  practical 


where  c*  is  given  by  (5).  Function  L(x,  r)  possesses  the 
following  properties: 

L(c,  r)  =  0  for  r  =  ropt  and  Vc  e  C 

L(c,  r)  >  0  for  V(c,  r)e  C  ®  {0,  rk } 
for  any  set  of  the  vectors  of  link  costs  Vc  e  C  .  Thus, 

4>ax  =  ™nF1L(C’r)S0 

ceC  re(0,F ) 

F  •  =  min  max  L(c,  r)  >  0 

re(0,F)  ceC 

Network  decision  to  admit  a  request  on  some  feasible  route 
r  e  F  exposes  the  network  to  potential  losses 

Ladm  (c)  +  Lrtn  (c,  r)  due  to  non-optimality  of  these 
decisions.  Network  decision  to  reject  a  request  exposes  the 
network  to  potential  losses  L'ej  (c)  due  to  non-optimality  of 
the  rejection  decision.  Loss  (19)  can  be  expressed  as  follows: 

f  L“dm  (c)  +  Lrl"  (c,  r)  if  r±0 
L(c,  r)  =  \  w  .  v  J  (20) 

[  Lre]  (c)  if  r  =  0 

Rejection,  admission  and  routing  losses  in  (20)  are  uniquely 
identified  as  follows: 


Lrej  (c\w)  =  max{0,cp(w-c*)} 
F'dm  (cl vv)  =  -  min{  0,  cp ( w  -  c* ) } 


(21) 

(22) 


the  cost  of  a  route  and  the  minimum  cost  of  a  feasible  route  are 
also  distributed  exponentially: 

Pr  {c\cr )  =  1  -  exp(-  c/cr ) 


Lrtn  (c,  r  w)  = 


fcp(w-c«) -<p(w-cr)  ifr^0 


(23) 


0  if  r  =  0 

Expressions  (21)-(23)  follow  from  (19)-(20)  and  the  fact  that 
Lr,n  ( C ,  r*)  =  0  ,  i.e.,  route  selection  (5)  does  not  cause  any 
loss.  Since 


Lrm  (c,  r)  =  Lrej  (c)  -  Ladm  (c)  -  <p(w  -  cr ) , 

the  total  loss  (19)  can  be  also  rewritten  as  follows: 

[  L"7  (c)  -  Cp  (w  -  cr )  ifr*0 
{C,r)  {  Lrej  (c)  if  r  =  0 

It  is  easy  to  see  that  the  rejection  loss  (21 )  is  monotonously 
decreasing  function  and  admission  risk  (22)  is  monotonously 
increasing  function  with  respect  to  the  partial  ordering  of  the 

vector  of  route  costs  c  =  (c  '.re  F)  .  Also  note  that 


Ladm  (c|w)  =  0  and  L'ej  (c|  w)  >  0  if  C*  <  W 
F'dm  (c\w)  >  0  and  Lej  (c\w)  =  0  if  C*  >  W 


Routing  risk  is  invariant  to  transformation  Cr  — >  C r  +  a  : 
Lr,n  (c,  r\w)  =  L""  (c  +  a,  r\w)  .  In  a  case  of  separable 
uncertainty  in  the  link  costs 

C/G  [cj.c,]  (24) 

it  is  natural  to  introduce  binary  variables  8 1  e  {0.1}  such  that 


Cl  =  (1  —  8,)?,  +5,0,  (25) 

and  consider  the  following  binary  loss  function  of  the  binary 
vector  8  =  (5 ;  )  : 


5(5,  r)  =  L(c,r ) 


q=(l-8,)c,+8,c, 


(26) 


Substituting  (25)  into  the  right-hand  side  of  (2 1  )-(23)  one 
easily  obtains  the  binary  rejection,  admission,  and  routing  loss 
functions. 


Risks 

Consider  a  case  when  the  costs  of  links  <y  are  mutually  jointly 
independent  random  variables  with  probability  distributions 
Pi  (c|0  7 )  ,  which  depend  on  some  parameters  0,  e  &f  : 

P(c\Q)=U,eLPl(c,p,)  (27) 

where  C  =  (Cj )  ,  0  =  (0;  )  .  Averaging  loss  function  (19) 

over  probability  distribution  (27),  we  obtain  the  following  risk 
function,  which  characterizes  the  risks  resulted  from  non- 
optimal  network  admission  and  routing  decisions  due  to  the 

uncertain  parameters  0,  G  0;  : 

R(Q ,  r)  =  Ep  [L(c,  r)]  =  J L(c,  r)P(dcfi )  (28) 

Using  (20)-(23)  it  is  possible  to  separate  total  risk  function  (28) 
into  rejection,  admission,  and  routing  risk  functions.  Note  that 
for  general  topology  network  and  arbitrary  distribution  (27) 
evaluation  of  the  risk  functions  is  a  difficult  task.  Consider  a 
particular  case  of  parallel  structure  when  different  routes  do  not 
overlap,  and  link  costs  distributed  exponentially.  In  this  case 


where  cr  =  c  (0  )  is  the  average  cost  of  a  route  r  ,  and 

pt  (c|c )  =  1  -  exp(-  c/c* ) 

where  the  average  cost  of  the  minimum  cost  route  C*  is 

determined  by  the  following  equation:  l/c*  =  ^  (l/Cr  )  > 

r  e  F  .  It  is  easy  to  verify  that  in  this  case  the  rejection, 
admission  and  routing  risk  functions  take  the  following  forms: 


-w/c,  w 

?  '  t • 


Rrej  = 


J(p  (x)ex/c'dx 


R 


adm 


-w/c*  0 

9  '  /• 


Jcp  (x)e'^c‘dx 


—w/c* 

9  ' 


R' 


w  ~w/cr  w 

J  cp  {x)exr‘  dx  -  e—^ —  J  cp  {x)eXCr  dx 


In  a  case  of  utility  function  (12),  these  risk  functions  can  be 
calculated  explicitly: 


R 


rej 


R 


R‘ 


co 


adm 


1  +  — -e~wy) 


CO 


coy 


1  -yc 

y c, 

1  -yc, ' 

c,  -  c* 


yc*  <  1 


,~wlc-  -vTT 


yc*  <  1 


ycr  <  i 


(l-ycr)(l-yc*) 

and  in  a  case  of  linear  utility  function  cp(x)  =  X  these  risk 
functions  take  the  following  simple  forms: 


Rrej  =w- 


t.(l-e~w/d') 


y  adm 


—  —w/c* 

'■  c*e  ' 


yrtn  —  -c* 


R‘ 

R"n  =cr 

Note  that  if  uncertainty  is  separable  with  respect  to  parameters 
0/  e  0~]  ,  it  is  useful  to  consider  the  binary  risk  function 
analogous  to  binary  loss  function  (26). 


4.  GAME  THEORETIC  FRAMEWORK 


Depending  on  the  ability  of  the  adversarial  environment  to 
coordinate  selections  of  the  link  costs  for  different  links, 
various  scenarios  for  uncertainty  are  possible.  We  consider 
two  extreme  cases  of  completely  centralized  and  completely 
decentralized  adversarial  environment.  Due  to  space 
constraints  we  only  consider  a  case  of  deterministic,  but 
uncertain  link  costs  (24).  It  can  be  shown  that  due  to  concavity 
of  function  Cp  the  optimal  strategy  for  the  adversarial 

environment  assigns  non-zero  probabilities  only  to  low  and 
upper  boundaries  C}  =  <y  and  <y  =  Ct  of  the  feasible 

intervals  Ct  e  [c/ ,  Ct  ] .  This  allows  us  to  deal  only  with 
binary  loss  function  (26). 

Centralized  Adversarial  Environment 


Consider  a  zero-sum  game  with  two  players,  where  player  (r) 
represents  the  network,  and  player  (c)  represents  the 
adversarial  environment  [11].  The  set  of  feasible  strategies  for 
the  network  is  re{0,R}  and  the  set  of  feasible  strategies 
for  the  environment  is  c  e  C  .  The  matrix  of  payoffs  made  by 
the  network  to  the  environment  L(c,  r|w)  is  given  by  (10). 
According  to  this  game  theoretic  framework,  the  optimal 
network  strategy  re  {0,R}  represents  the  admission  and 
routing  strategy  guarding  against  the  worst  case  scenario  with 
respect  to  the  route  costs  ce  C  .  The  value  of  the  game 

V  =  v(w|C,  r)  represents  the  expected  performance  loss 

due  to  the  admission  and  routing  decisions  r  e  {0,  R]  for  a 
single  request  under  incomplete  information  on  the  implied 
costs  of  the  resources  C£  C  selected  by  adversarial 
environment.  In  a  particular  case  when  the  payoff  function 

L(c,  r\w)  has  a  saddle  point,  i.e.,  L =0,  the 

environment  and  the  network  have  pure  optimal  strategies  and 
the  value  of  the  game  is  V  =  0  .  In  a  case  when  the  payoff 

function  L(c,  r|w)  does  not  have  a  saddle  point,  i.e., 

Fff  >  0 ,  the  environment  and  the  network  have  mixed 
optimal  strategies  which  are  probability  distributions  on 
ce  C  and  re  {0,R}  respectively,  and  the  value  of  the 
game  is  V  >  0  . 

Note,  that  according  to  the  centralized  scenario  the 
environment  is  free  to  assign  non-zero  probabilities  to  all 

possible  2L  combinations  of  binary  variables  8;  e  {0,1}, 
i.e., 

(5,  :Ie  R)e  {0,1}L  (29) 


Decentralized  Adversarial  Environment 

In  the  "decentralized"  scenario  the  environment  is  capable  of 

random  selection  of  each  binary  variable  8,  e  {0,1},  but 
selections  for  different  links  are  independent  from  each  other: 

Pr{5/:V/}=nP/8'(l-P/)1'8'  OO) 

reR 


where 

jP,  if  5,=1 
{0  if  8;  =  0 


(31) 


This  scenario  can  be  modeled  as  a  non-cooperative  game  of 
K  + 1  players  [11],  Player  (r)  with  a  set  of  feasible 


strategies  re{0,R}  and  utility  function  — L{c,rw ) 


represents  the  network.  A  player  (8 , )  with  a  set  of  feasible 

strategies  8;  e  {0,1}  and  utility  function  L(c,  r|w) 

represents  a  player  selecting  the  cost  of  the  link  /  .  The 
network  makes  admission  and  routing  decisions  re  {0,R} 

with  probabilities  0C(.  >  0 ,  ^^0Cr  =  1 ,  where  the  admission 
probability  is 

aE  =£a(. 

reR 


and  the  rejection  probability  is  CL0  =  \—CL-l  .  A  player 

(8 1 )  randomly  selects  the  binary  variable  8  /  with 

probabilities  (31).  Selections  by  all  players  are  independent 
from  each  other,  i.e.,  (30)  holds.  This  selection  results  in  the 
average  loss 

5((3,a)  =  £a, £ 5(8 , r)f]  pf'  (1  -  p, )'-5'  (33) 

r  8  / 

The  non-cooperative  (Nash)  equilibrium  is  determined  by 
solution  to  the  following  optimization  problem  [11]: 

V  =  5(P*,a*|w)  =  minmax5(P,a|w)  (34) 

a  p 

subject  to  constraints 

Lar  =1,  ar  >  0,  re  {0,R}  (35) 

0<p,<l,V/  (36) 

According  to  this  game  theoretic  framework,  the  optimal 
network  strategy  selectas  route  reR  with  probability  CL  . 

The  optimal  admission  probability  is  OCj,  =  ^0Cr  ,  reR. 

The  optimal  average  loss  due  to  uncertainty  is  represented  by 
(34). 


5.  SOLUTION  FOR  A  SYMMETRIC  CASE 

In  this  section  we  explicitly  identify  the  optimal  network 
strategies  by  solving  the  corresponding  games  in  a  case  of 
parallel  homogeneous  structure  when  costs  of  all  feasible 
routes  lie  within  the  same  confidence  interval: 

cr  e  [c,c]  (37) 

In  this  case  the  network  has  two  pure  admission  strategies:  to 
accept  or  reject  an  arriving  request.  Our  goal  is  to  find  the 

* 

optimal  admission  probability  CL^  .  Once  admitted,  the  request 
is  carried  on  a  route  r  selected  equiprobably  from  the  set  of 
K  feasible  routes:  0Cr  =  (X  L  /  K  .  re  F  . 


Centralized  Adversarial  Environment 

Since  a  case  of  a  single  feasible  route  K  =  1  is  covered  in  [7], 
in  this  and  next  subsections  we  assume  that  K  >  2  .  We 
consider  K  +  1  pure  strategies  for  the  malicious  environment. 
Strategy  Sk  ,  k  =  0 ,..,K  assigns  C  =  C  for  a  set  of  k 

feasible  routes  re  { /'  :  i  =  il,..,ik  }  ,  randomly,  with  equal 
probabilities  selected  from  F  ={/],..,  rK }  and  assigns 
cr  =  C  for  routes  re  F  \  { r  :  i  =  il  ,..,ik  }  .  The  pay-off 
matrix  (19)  takes  the  form  of  the  following  (A"  +  l)x2 

matrix  L  =  (l,  .  V"’*  : 

v  V  >k,j= o 

reject  accept 


sk  •  Lk0  Lk i 


where  the  risk  associated  with  rejection  is 

Jmax{0,(p(w-c)}  if  k 
[max{0,(p(w-c)}  if 
the  risk  associated  with  admission  is 

[max{0,(p(w  -  ?)}  -(p^ 
i  -min{0,cp(w-c)} 


Lko  ~ ' 


4 1  =■ 


=  0,..,K-\ 
k  =  K 

if  k  <  K  - 1 
if  k  =  K 


(32) 


and  the  expected  utility  of  servicing  a  request  of  cost  W ,  given 
the  environment  strategy  S .  ,  is 


<Pt  =— cp  (w-c)  + 
K 


1 - p(vv-c) 

K 


A  (K+ l)x2  game  can  be  solved  explicitly  [11].  It  is  easy  to 

verify  that  this  game  always  has  a  saddle  point  if  K  >2  .  The 
optimal  admission  probability  is 

*  ft)  if  W  <W* 
aL  =< 

1  1  if  w>  w 


where  W  =  W  is  the  unique  solution  to  the  following 
equation: 

cp(w-c)  +(K  -l)cp(w-c)  =0  (38) 

The  optimal  strategy  for  the  environment  is  S  °p’  =  S  ,  where 


*  I  K  if  W  <  C 
{ /f  -  1  if  w  >  c 
The  value  of  the  game  is 

0  if  w  <  c 
V  =  5  cp (w-c)  if  c<w<w 
cp (w  -  c)  if  w  >  w 

For  utility  function  (12)  equation  (38)  can  be  solved  explicitly: 


w*  =-log, 
Y 


exp(yc )  +  ( K  - 1)  exp(yc) 
K 


In  a  particular  case  of  a  linear  utility  function  cp  (^ )  =  t, 
equation  (38)  yields: 

c  +  (K  -  l)c 


w  = 


K 


Decentralized  Adversarial  Environment 

In  a  case  of  question  the  average  loss  (24)  takes  the  following 
form: 

S(P,a|w)  =  (1-  (3  R  )max{0,cp(w-c)}  + 

(3 K  max{0,cp(w-c)}-a[(l-  (3)cp(w-c)+  (3cp(w-c)] 


where  P,  =  P  ,  Vr  G  R  .  It  can  be  shown  that  the  solution 
to  the  optimization  problem  (34)-(36)  is  as  follows.  The 
optimal  admission  probability  is 

*  0  if  w  <W 

av=i 

1  if  w  >  w 


and  the  optimal  strategy  for  the  environment  is 

$ 

0  if  w  <  w 


P*  = 


cp(vv-c) -cp  (w-c) 
Kty{w-c) 


K~\ 


if  w  <w  <  c 
if  w  >  c 


where  W  =  W  is  the  unique  solution  to  the  following 
equation: 

cp  (w  -  c)  +  [k  l/  K  -  l)p  (w  -  c)  =  0  (39) 

For  utility  function  (12)  equation  (39)  can  be  solved  explicitly: 


Vt; 


1 

-log, 

Y 


exp(yc)  +  (Kl/K  -l)exp(yc) 

K V* 


In  a  particular  case  of  a  linear  utility  function  Cp  (^ )  =  £, 
equation  (39)  yields: 


W 


d  +  (K1/K  -1  )c 


6.  CONCLUSIONS 


This  paper  proposes  a  framework  for  performance  evaluation 
and  optimization  of  randomized  routing.  The  framework  is 
based  on  interpreting  randomized  routing  as  a  regularized 
solution  to  the  route  cost  minimization  problem.  Special 
attention  is  paid  to  the  game  theoretic  framework  for  the 
regularization,  intended  to  guard  against  the  worst  case 
scenario  with  respect  to  uncertain  parameters  lying  within 
known  "confidence"  regions.  According  to  this  game-theoretic 
framework  the  optimal  network  strategy  is  identified  with  the 
Nash  equilibrium  in  the  corresponding  game.  The  paper 
explicitly  identifies  the  optimal  strategy  in  a  case  of  parallel, 
homogeneous  structure  under  various  assumptions  on  the 
ability  of  adversarial  environment  to  manipulate  the  link  costs. 
Future  efforts  should  be  directed  towards  developing 
computationally  feasible  solutions  for  the  corresponding  games 
for  more  realistic  topologies. 
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